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Abstract 

We  present  an  algorithmic  model  for  distributed  computation  of  fixed 

points  whereby  several  processors  participate  simultaneously  in  the  calcula¬ 
tions  while  exchanging  information  via  communication  links.  We  place  essential¬ 
ly  no  assumptions  on  the  ordering  of  computatiojv^nd  communication  between 
processors  thereby  allowing  for  completely  uncoordinated  execution.  We 
provide  a  general  convergence  theorem  for  algorithms  of  this  type,  and 
demonstrate  its  applicability  to  several  classes  of  problems  including  the 
calculation  of  fixed  points  of  contraction  and  monotone  mappings  arising  in 
linear  and  nonlinear  systems  of  equations,  shortest  path  problems,  and 
dynamic  programming. 
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1 .  Introduction 

There  is  presently  a  great  deal  of  interest  in  distributed  implementations 
of  various  iterative  algorithms  whereby  the  computational  load  is  shared  by 
several  processors  while  coordination  is  maintained  by  information  exchange 
via  communication  links.  In  most  of  the  work  done  in  this  area  the  start¬ 
ing  point  is  some  iterative  algorithm  which  is  guaranteed  to  converge  to  the 
correct  solution  under  the  usual  circumstances  of  centralized  computation  in 
a  single  processor.  The  computational  load  of  the  typical  iteration  is  then 
divided  in  some  way  between  the  available  processors,  and  it  is  assumed  that 
the  processors  exchange  all  necessary  information  regarding  the  outcomes  of 
the  current  iteration  before  a  new  iteration  can  begin. 

The  mode  of  operation  described  above  may  be  termed  synchronous  in  the 
sense  that  each  processor  must  complete  its  assigned  portion  of  an  iteration 
and  communicate  the  results  to  every  other  processor  before  a  new  iteration 
can  begin.  This  assumption  certainly  enchances  the  orderly  operation  of 
the  algorithm  and  greatly  simplifies  the  convergence  analysis.  On  the 
other  hand  synchronous  distributed  algorithms  also  have  some  obvious  imple¬ 
mentation  disadvantages  such  as  the  need  for  an  algorithm  initiation  and 
iteration  synchronization  protocol.  Furthermore  the  speed  of  computation 
is  limited  to  that  of  the  slowest  processor.  It  is  thus  interesting  to 
consider  algorithms  that  can  tolerate  a  more  flexible  ordering  of  computation 
and  communication  between  processors.  Such  algorithms  have  so  far  found 
applications  in  computer  communication  networks  such  as  the  ARPANET  [1] 
where  processor  failures  are  common  and  it  is  quite  complicated  to  maintain 
synchronization  between  the  nodes  of  the  entire  network  as  they  execute 
real-time  network  functions  such  as  the  routing  algorithm. 

In  this  paper  we  consider  an  extreme  model  of  uncoordinated  distributed 
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algorithms  whereby  computation  and  communication  is  performed 
at  the  various  processors  completely  independently  of  the  progress  in 
other  processors.  Perhaps  somewhat  surprisingly  we  find  that  even  under 
these  potentially  chaotic  circumstances  of  uncoordinated  computation  it  is 
possible  to  solve  correctly  broad  and  significant  classes  of  fixed  point 
problems.  A  general  convergence  theorem  is  developed  for  this  purpose 
which  delineates  circumstances  under  which  convergence  is  guaranteed.  The 
theorem  is  then  applied  to  broad  classes  of  fixed  point  problems  involving 
contraction  and  monotone  mappings. 

2.  A  Model  for  Distributed  Uncoordinated  Fixed  Point  Algorithms 

The  fixed  point  problem  considered  in  this  paper  is  defined  in  terms 
of  a  set  X,  a  class  F  of  functions  mapping  X  into  the  extended  real  line 
[_oo^+<xj],  and  a  mapping  T  which  maps  F  into  itself.  We  wish  to  find  an  element 
J*  of  F  such  that 

J*  =  T(J*).  (1) 

or  equivalently 

J*(x)  =  T(J*)(x),  YxeX,  (2) 

where  J*(x)  and  T(J*)(x)  denote  the  values  of  the  functions  J*.  and  T(J*) 
respectively  at  the  typical  element  xeX.  We  will  assume  throughout  that 
T  has  a  unique  fixed  point  J*  within  the  set  F. 

We  provide  some  examples: 

Example  1:  (Fixed  points  of  mappings  on  r").  Let  X  be  the  finite  set 
X  =  {1,2,. ..,n}. 


k 


and  F  be  the  set  of  all  real-valued  functions  on  X.  Then  F  can  be  identified 
with' the  n-dimensional  space  R*'  in  the  sense  that  with  each  JeF  we  can  as¬ 
sociate  the  n-dimensional  vector  {J(l) ,J(2) , . . . , J(n) }.  Similarly  T(J)  can 
be  identified  with  the  n-dimensional  vector  TCJ) (1) , . . . ,TCJ) (n)  ,  so  the  fixed 
point  problem  (1)  amounts  to  solving  the  system  of  n  equations 

J*  =  T(J*)  or  J*(i)  =  T(J*)(i).  Yi  *  l.....n  (3) 

with  the  n  unknovms  J*(l) , . . . ,J*(n) .  It  is  also  evident  that  any  system 
of  n  (possibly  nonlinear)  equations  with  n  unknowns  can  be  formulated  into 
a  fixed  point  problem  such  as  (3) . 

Example  2;  (Shortest  path  problems).  Let  (M, L)  be  a  directed  graph  where 
M  =  {l,2,..,,n}  denotes  the  set  of  nodes  and  L  denotes  the  set  of  links. 

Let  N(i)  denote  the  downstream  neighbors  of  node  i,  i.e.,  the  set  of  nodes 
j  for  which  (i,j)  is  a  link.  Assume  that  each  link  (i,j)  is  assigned  a 
positive  scalar  a^^^  referred  to  as  its  length.  Assume  also  that  there  is 
a  directed  path  to  node  1  from  every  other  node.  Then  it  is  known  ([2], 
p.67)  that  the  shortest  path  distances  J*(i)  to  node  1  from  all  other  nodes 
i  solve  uniquely  the  equations 

J*Ci)  »  min  {a.  .  +  J*(j)}  ,  Y  i  1  (4a) 

j'eN(i) 

J*(l)  »  0  (4b) 

If  we  make  the  identifications  X  =  {l,2,...,n},  F:  Set  of  all  functions 
mapping  X  into  [0,+<»],  and  define  T(J)  for  all  JeF  by  means  of 
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♦ 

(  min  {a..  +  J(j)}  if  i  1 
)  jENCi) 

T(J)(i)  «  'j  (5) 

(  0  if  i  =  1 

then  we  find  that  the  fixed  point  problem  (2)  reduces  to  the  shortest  path 
problem. 

The  shortest  path  problem  above  is  representative  of  a  broad  class  of 
dynamic  programming  problems  which  can  be  viewed  as  special  cases  of  the 
fixed  point  problem  (2)  and  can  be  correctly  solved  by  using  the  distributed 
algorithms  of  this  paper  (see  [3]). 

Our  algorithmic  model  can  be  described  in  terms  of  a  collection  of  n 
computation  centers  (or  processors)  referred  to  as  nodes  and  denoted  l,2,...,n. 

The  set  X  is  partitioned  into  n  disjoint  sets  denoted  i.e. 

n 

X  =  U  X.  ,  X.  n  X.  =  0,  if  i  j. 

i=l  ^  ^ 

Each  node  i  is  assigned  the  responsibility  of  computing  the  values  of  the 
solution  function  J*  [c.f.  (1),(2)]  at  all  xeX^. 

At  each  time  instant,  node  i  can  be  in  one  of  three  possible  states 
compute,  transmit ,  or  idle.  In  the  compute  state  node  i  computes  a  new 
estimate  of  the  values  of  the  solution  function  J*  for  all  xcX^.  In  the 
transmit  state  node  i  communicates  the  estimate  obtained  from  the  latest 
computation  to  one  or  more  nodes  j  (jj^i) .  In  the  idle  state  node  i  does 
nothing  related  to  the  solution  of  the  problem.  It  is  assumed  that  a  node 
can  receive  a  transmission  from  other  nodes  simultaneously  with  computing 
or  transmitting,  but  this  is  not  a  real  restriction  since,  if  needed,  a 
time  period  in  a  separate  receive  state  can  be  lumped  into  a  time  period  in 


the  idle  state. 


We  assume  that  computation  and  transmission  for  each  node  takes  place 


in  uninterupted  time  intervals  [tj^»t2l  with  t^^  ^  ^2’  exclude  the 

possibility  that  a  node  may  be  simultaneously  transmitting  to  more  than  one 
nodes  nor  do  we  assume  that  the  transmission  intervals  to  these  nodes  have 
the  same  origin  and/or  termination.  We  also  make  no  assumptions  on  the 
length,  timing  and  sequencing  of  computation  and  transmission  intervals 
other  than  the  following; 

Assxamption  (A) :  There  exists  a  positive  scalar  P  such  that,  for  every  node 

i,  every  time  interval  of  length  P  contains  at  least  one  computation  interval 

for  i  and  at  least  one  transmission  interval  from  i  to  each  node  j  ^  i. 

Each  node  i  also  has  a  buffer  B. .  for  each  i  i  where  it  stores  the 

1] 

latest  transmission  from  j,  as  well  as  a  buffer  B. .  where  it  stores  its  own 

estimate  of  values  of  the  solution  fiinction  for  all  xsX. .  The  contents  of 

1 

each  buffer  B. .  at  time  t  are  denoted  j5..  Thus  J?.  is,  for  every  t,  a  func- 
tion  fromX^  into  [-<»,<“]  and  may  be  viewed  as  the  estimate  by  node  i  of  the 
restriction  of  the  solution  function  J*  on  available  at  time  t.  The 
rules  according  to  which  the  functions  are  updated  are  as  follows: 

1)  If  [t.,t-]  is  a  transmission  interval  from  node  j  to  node  i  the  contents 
^1 

Jjj  of  the  buffer  B^^  at  time  tj^  are  transmitted  and  entered  in  the  buffer 
Bj^^  at  time  tj,  i-e. 


(6) 


2)  If  [t.ft.]  is  a  computation  interval  for  node  i  the  contents  of  buffer 
Bj^^  at  time  t2  are  replaced  by  the  restriction  of  the  function  TfJ^  )  on 
Xj^  where,  for  all  t,  j5  is  defined  by 


6- 

if  xeX. 

1 

if  xeXj,  j  i  (7) 

J.‘(x)  »  TCJ.^Hx),  YxeX.  (8) 

3)  The  contents  of  a  buffer  can  change  only  at  the  end  of  a  computation 
interval  for  node  i.  The  contents  of  a  buffer  ,  j  i  can  change  only 
at  the  end  of  a  transmission  interval  from  j  to  i. 

Our  objective  is  to  derive  conditions  under  which 

lim  j5(x)  =  J*Cxj,  YxeXj^,  i  =  l,2,...,n,  (9) 

t-w  ^ 

and  J*  is  the  unique  fixed  point  of  T  within  F  [cf.  (1),C2)].  This  is  the 
subject  of  the  next  section. 

3.  A  General  Convergence  Theorem 

We  formulate  the  following  assumption  under  which  we  will  subsequently 
prove  convergence  of  the  type  indicated  in  (9).  In  what  follows  F  denotes 
the  set  of  all  functions  from  F  into  [-“,+*>],  F  x  F  denotes  the  Cartesian 
product  of  the  set  of  functions  F  with  itself,  and  f”  denotes  the  Cartesian 
product  of  F  with  itself  n  times. 

Assumption  B:  There  exists  a  sequence  {Fj^}  of  subsets  of  F  with  the  fol¬ 
lowing  properties: 

a)  If  {Jj^}  is  a  sequence  in  F  such  that  for  all  k  then 

lim  J,(x)  ■  J*(x)  YxeX.  (10) 

k-K» 


In  other  words  we  have 


7 


i 
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b)  For  all  k  »  0,1,...  and  i  =  l,...,n 


where  T^:  F  -*■  F  is  the  mapping  defined  by 


J(x) 


T^CJ) Cx) 


if  xiX.^ 


T(J3Cx3  if  xeX^. 


c)  For  all  k  =  0,1,...  and  jel,...,n 


JeFj^,  C.(J,J')e  Fj^ 


where  ;  F  x  F  -*•  F  is  the  mapping  defined  by 


C^CJ.J’)(x)  » 


J(X) 

if 

x^X^ 

J’(X) 

if 

X 

(•> 

X 

d)  For  all  k  =  0,1,., 


Jl^Fj^, . . .  —p  T(J^,J2,  . . . 


where  T:  f”  -*•  F  is  the  mapping  defined  by 


(11) 


(12) 


(13) 


(14) 


(15) 


T(J^.J2,...,Jjj)(x)  »  T(jp(x),  VxeX^,  i  =  l,...,n  (16) 

Assumption  B  seems  rather  complicated  so  it  may  be  worth  providing  some 
motivation  for  introducing  it.  Property  a)  specifies  hov.'  the  sets  Fj^  should 
relate  to  the  solution  J*.  Property  d)  guarantees  that  if  the  functions  in 
the  buffers  of  all  nodes  i  >  l,...,n  belong  to  Fj^  and  a  computation  phase  is 
carried  out  simultaneotisly  at  all  nodes  followed  by  a  communication  phase 


from  every  node  to  every  other  node  then  the  resulting  function  in  the 
buffer  of  each  node  (which  will  be  the  same  for  all  nodes),  will  belong  to 

Assumptions  aj  and  d)  alone  guarantee  that  the  algorithm  will  converge 
to  the  correct  solution  if  executed  in  a  synchronous  manner,  i.e.,  a 
simultaneous  computation  phase  at  all  nodes  is  followed  by  a  simultaneous 
communication  phase  from  each  node  to  all  other  nodes  and  the  process  is 
repeated.  Property  b)  involves  the  mapping  which  is  related  to  a  com¬ 
putation  phase  at  node  i  [compare  (7),  (8)  with  (12)],  while  property  c) 
involves  the  mapping  which  is  related  to  a  communication  phase  from 
node  j  to  some  other  node  [compare  (6)  with  (13),  (14)].  Basically  properties 
b)  and  c)  guarantee  that  the  sets  are  closed  with  respect  to  individual 
node  computation  and  communication.  By  this  we  mean  that  if  all  buffer 
contents  are  within  Fj^  then  after  a  single  node  computation  or  communication 
all  buffer  contents  will  remain  in  Fj^.  The  following  proposition  asserts 
that  when  properties  b)  and  c)  hold  in  addition  to  a)  and  d) ,  then  the 
algorithm  converges  to  the  correct  solution  when  operated  in  a  totally 
uncoordinated  manner. 

Proposition:  Let  Assumptions  A  and  B  hold,  and  assiime  that  the  initial 
buffer  contents  J?  at  each  node  i  *  1, ,n  belong  to  F^.  Then 

lim  j5(x)  =  J*(x),  YxeX,  i  =  l,...,n  (17) 

t-W»  ^ 

where  J?  is  defined  by  (7)  for  all  t  ^  0  and  i  *  l,...,n. 


Proof:  We  will  show  that  for  every  k  =  0,1,...  and  t  >  0  the  condition 


J^eF^,  Ya  *  l,...,n 


implies 
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■>r  ^  \  ■ 

Yt'  >  t,  i  =  l,...,n 

(19) 

Y  t'  >  t+2P,  i  =  1, . . . ,n 

(20) 

where  P  is  the  scalar  of  Assumption  A.  In  view  of  condition  a)  of  Assumption 
B,  this  will  suffice  to  prove  the  proposition. 

Assume  that  (18)  holds  for  some  k  =  0,1, _  and  t  ^  0.  Then  (19)  clear- 

ly  holds  since,  fort'^t,  the  buffer  content  of  node  i  at  t'  is  obtained 
from  the  buffer  contents  of  all  nodes  j  *  l,...,n  at  t  via  operations  that 
(according  to  conditions  b)  and  c)  of  Assumption  B)  preserve  membership  in 

^k- 

t* 

Consider  the  contents  J. .  of  the  buffers  B. . ,  i  =  l,...,n  at  a  time 

11  11 

t'  ^  t+P.  Since  (by  Assumption  A)  at  least  one  computation  was  performed 
at  each  node  i  in  the  interval  [t,t+P],  we  have  that  [cf.  (7)] 

jJ^(x)  =  T(jJ)(x),  YxeX.,  i  =  l,,...n  (21) 

where  j5  is  the  buffer  content  of  node  i  at  some  time  te[t,t']  (t  depends 
on  i) ,  and  by  (19) 

*  l,...,n. 

Since  the  interval  [t+P,  t+2P]  contains  at  least  one  communication  interval 
from  every  node  to  every  other  node  it  follows  that  for  any  t’  >  t+2P  each 
buffer  Bj^j  contains  a  function  J^,  such  that  [cf.  (6),  (21)] 

j.J(x)  »  J^(x)  -  T(jJ)(x),  YxeX.,  i,j  -  l....,n  (22) 

where  is  the  content  of  buffer  B^^  at  node  j  at  some  time  te[t+P,t+2P] 


and  is  the  buffer  content  of  node  j  at  some  time  te[t,t].  (Again  here 
the  times  t  and  t  depend  on  i  and  j ) . 

By  using  (22)  and  (19)  we  can  assert  that  for  each  t'  ^  t+2P  and 

i  =  l,...,n  there  exist  functions  J.eF.  ,  j  =  l,...,n  such  that 

J 

J^'(x)  =  T(Jj)(x).  xeX^,  i  =  l....,n. 

It  follows  from  condition  d)  of  Assumption  B  [cf.  (15), (16)]  that 
jVe  Fj^^l  ,  Yt'  >  t+2P,  i  =■  l,...,n 
which  is  (20).  This  completes  the  proof  of  the  proposition,  Q.E.D. 

Note  that  (18)  and  (20)  can  form  the  basis  for  an  estimate  of  the 
rate  of  convergence  of  the  algorithm.  For  example  if  there  exists  an 
index  k  such  that  k  ^  k  (i.e.  after  some  index  the 

sets  Fj^  contains  only  one  element — the  solution  function  J*) ,  then  it  fol¬ 
lows  from  (18) -(20)  that  the  distributed  algorithm  converges  to  the  correct 
solution  in  a  finite  amount  of  time.  This  argument  can,  for  example,  be 
used  to  establish  finite  time  convergence  for  the  distributed  algorithm  as 
applied  to  the  shortest  path  problem  of  Section  2. 


4.  Special  Cases 

In  this  section  we  verify  that  Assinnption  B  of  the  previous  section 
is  satisfied  for  some  important  classes  of  problems. 

Contraction  Mappings  with  Respect  to  the  Sup-Norm 

Let  F  be  the  space  of  all  bounded  real -valued  functions  on  X  and 
assume  that  T(J)cF  for  all  JeF.  Let  jl*]!  denote  the  sup-norm  on  this 
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space,  i.e. 

llJll  =  sup  1jCx)1.  VxeX.  (23) 

xeX 

Assume  that  F  is  a  closed  sphere  centered  at  J*.  Then  F  is  complete 
([4]),  so  if  there  exists  a  scalar  a  with  0  <  a<  1  such  that  the  mapping 
T  satisfies 


1|T(J)  -  T(J’)11  <  allJ-J'll.  VJ.J'eF 


there  T  has  a  unique  fixed  point  in  F  denoted  J*  [4] . 
For  q  >  0  define 


=  {JeF 


1J-J*11  < 


k  , 
Ct  q}. 


0,1,, 


It  is  evident  that  if  F^F  then  the  sequence  {Fj^}  satisfies  conditions 
a)-d)  of  Assumption  B. 

We  note  that  the  use  of  the  sup-norm  (23)  is  essential  in  order  for 
Assumption  B  to  hold  and  that  if  T  is  a  contraction  mapping  with  respect 
to  some  other  norm  then  Assumption  B  need  not  be  satisfied. 

An  important  example  where  T  is  a  contraction  mapping  with  respect  to 
the  sup-norm  arises  in  Newton's  method  for  solving  nonlinear  systems  of 
equations.  Let  G;  r”  -*■  r"  be  a  continuously  differentiable  mapping  and 
assume  that  J*eR”  satisfies  G(J*)  =  0  and  that  the  nxn  Jacobian  ^ 

is  nonsingular  at  J*. 

Then  it  can  be  shown  that  the  Newton  mapping 


T(J) 


3G(J) 

3J 


G(J) 
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is  a  contraction  mapping  with  respect  to  the  sup-norm  within  a  neighborhood 
of  J*  and  therefore  satisfies  Assumption  B  within  that  neighborhood. 
P-Contraction  Mappings 

Let  X  =  {1,2, — ,n}  and  =  {i}.  Then  functions  J  can  be  identified 
with  the  corresponding  n-dimensional  vectors  (JCl) , . . . , J(n) }  and  F  can  be 
identified  with  a  subset  of  r”.  For  each  J  =  {J(l) , . . . JCn) }  we  denote  by 
|j1  the  vector  { [ J(l) 1 , . . . , ] J(n) [ }.  Suppose  that  T  is  such  that 

iTCJ)  -T(J')1  <  P  iJ-J’l  .  VJ.J'er"  C24) 

where  P  is  a  substochastic  matrix,  i.e.  all  elements  of  P  are  nonnegative 

and  the  sum  of  the  elements  of  each  row  of  P  is  less  than  or  equal  to 

unity,  and  the  inequality  (24]  is  meant  to  hold  componentwise.  Assume 
k 

further  that  lim  P  *  0.  Then  it  can  be  shown  that  T  has  a  unique  fixed 
point  J*  in  r”  ([5],  p.433). 

For  any  q  >  0  define 

Fj^  =  {JeR^l  lJ-J*l  <  q  P’^e} 

where  e  =  {1,1,...,!}  is  the  unit  vector  in  r’^'.  Then  it  can  easily  be 
seen  again  that  the  sequence  {Fj^}  satisfies  conditions  a)-d)  of  Assumption 
B. 

Fixed  point  problems  involving  P-contraction  mappings  arise  in  dynamic 
programming  ([6],  p.374]  and  solution  of  systems  of  nonlinear  equations 
([5],  Section  13.1]. 

Monotone  Mappings 

Assxime  that  T  has  the  monotonicity  property 
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JeF,  J'eF,  JCx)  <  J’Cx).  VxeX  af  T(J)  (x)  <  T(J’)Cx).  YxeX  (25) 

Assume  further  that  there  exist  two  functions  J  and  J  in  F  such  that 

{J|  J(x)  <  JCx)  <  J(x),  YxeX}  c  F  (26) 

and  for  all  k  »  0,1,... 

t’'(J)(x)  <  (J)(x)  <  (J)(x)  <  T^(J)(x),  YXeX 

(27) 

and 

lim  T^(J)(x)  =  limT^(J)(x)  =  J*(x),  YxeX.  (28) 

k-«n  k-*« 

As  an  example  consider  the  shortest  path  problem  of  Example  2  in 
Section  2,  and  the  functions 

J(i)  =0,  Yi  =  l,...,n 

ioo  if  i  #  1 

0  if  i  =  1. 

It  is  easily  verified  that  the  corresponding  mapping  T  satisfies  (25)  and 
that  J,  J  defined  above  satisfy  (26),  (27),  (28), 

Define  now  for  k  ■  0,1,... 

F]^  »  (J  I  t’'(J)(x)  <  J(x)  <  t’‘(J)(x),  xeX}  . 

Then  it  is  easily  seen  that  the  sequence  {Fj^}  satisfies  conditions  a)-d) 
of  Assumption  B. 
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Fixed  point  problems  involving  monotone  mappings  satisfying  (25) 
arise  in  dynamic  programming  [3],  [6],  [7]  and  solution  of  systems  of 
nonlinear  equations  ([5],  Section  13.2). 

5.  Conclusions 

The  analysis  of  this  paper  shows  that  broad  classes  of  fixed  point 
problems  can  be  solved  by  distributed  algorithms  that  operate  under  very 
weak  restrictions  on  the  timing  and  ordering  of  processor  computation  and 
communication  phases.  It  is  also  interesting  that  the  initial  processor 
buffer  contents  need  not  be  identical  and  can  vary  within  a  broad  range. 

This  means  that  for  problems  that  are  being  solved  continuously  in  real 
time  it  is  not  necessary  to  reset  the  initial  conditions  and  resynchronize 
the  algorithm  each  time  the  problem  data  changes.  As  a  result  the  potential 
for  tracking  slow  changes  in  the  solution  function  is  improved  and  algo¬ 
rithmic  implementation  is  greatly  simplified. 


-15- 


References 


[1]  J.  McQuillan,  G.  Falk,  and  I.  Richer,  "A  Review  of  the  Development 
and  Performance  of  the  ARPANET  Routing  Algorithm",  IEEE  Trans,  on 
Communications,  Vo 1.  COM-26,  1978,  pp.  1802-1811. 

[2]  E.  L.  Lawler,  Combinatorial  Optimization:  .Networks  and  Matroids, 

Holt,  Rinehart,  and  Winston,  N.Y.,  1976. 

[3]  D.  P.  Bertsekas,  "Distributed  Dynamic  Programming",  Report  LIDS-P-1060, 
Laboratory  for  Information  and  Decision  Systems,  Mass.  Institute  of 
Technology,  Cambridge,  Mass.,  Dec.  1980  (to  appear  in  IEEE  Trans,  on 
Automatic  Control) . 

[4]  H.  L.  Royden,  Real  Analysis,  McMillan,  N.Y.,  1963. 

[5]  J.  M.  Ortega  and  W.  C.  Rheinboldt,  Iterative  Solution  of  Nonlinear 
Equations  in  Several  Variables,  Academic  Press,  N.Y.,  1970. 

[6]  D,  P.  Bertsekas,  Dynamic  Programming  and  Stochastic  Control,  Academic 
Press,  N.Y.,  1976. 

[7]  D.  P.  Bertsekas  and  S.  E.  Shreve,  Stochastic  Optimal  Control;  The 
Discrete  Time  Case,  Academic  Press,  N.Y.,  1978. 


END 

DATE 

FILMED 

10-81 

DTIC 


